perf(workers): use the final VM sweep during shutdown - #154

Worker shutdown performs a full tracing collection immediately before mandatory VM destruction. Move that preliminary collection to the main-process-only caller; Workers retain native/environment cleanup, code deletion, VM reference draining and last-chance finalization. No VM reuse or deferred acknowledged cleanup is introduced. This is rebased on the finalized ownership in #152 and the merged EventNames cleanup in #153.

The heap-specific regression fails the unchanged baseline at the extra full collection and passes both Worker exit routes. The current-head Mac run passes 271 Worker destruction/N-API/finalizer tests; the original eight-resource fixture remains 8/8 with zero fds, and WAL durability/reopen checks pass. Three OpenClaw cleanup/retirement files pass 13 tests on Node and 13 on the integration. The earlier frozen integration's surrounding Worker suites pass 303 tests with 20 existing gated skips.

Fixed paired integration measurements use the same frozen Bun/engine source and build settings in both arms. The companion engine change is openclaw/WebKit#31; no standalone-Bun attribution is inferred from combined numbers.

Each component cell has 20 observations in fixed forward/reverse order. Empty Mac point estimates are mixed; no universal speedup or Node parity is claimed. Separate phase logs show one preliminary collection before and zero after. Some destructor work moves into the final sweep rather than disappearing.

Full Gateway before/after AB/BA keeps the workload and 2,000 ms grace unchanged: 80/80 Linux workloads and 82 completed Mac workloads exit cleanly under the bound, with no kill attempt. Two Mac setup failures remain recorded. Linux medians improve 912.05→806.92 ms without trace and 997.33→874.01 ms with trace; Mac trace-off improves modestly, while trace-on has a small mixed regression. Both baseline and candidate meet the bound in this sample, so historical deadline misses are not proved eliminated by this change.

Calibrated ASAN tests retain the stronger ten-resource callback/thread/null-env/reentry assertions through 100 Workers. The frozen before/after comparison has only the known cache/parser leak sites. A fully rebuilt local composition with the separate cache/parser fixes passes 1,000 Workers on both routes and 100 retained-addon Workers per route under ASAN/LSAN, using only the inherited console suppression. Its unprimed exact-key string finalizes once with null env on the creator thread. No new suppression or lifetime-policy exception is introduced; the parser fix remains separate.

P2 review is scoped-clean. At head 3851747d2e747f7f92fed8cc9b0d1d7ce1bc4e2d, Linux/macOS native CI and Windows x64/ARM64 builds, smoke tests and compatibility tests pass, as do formatting and source/JavaScript lint. Windows attempt 1 stopped in provisioning on Docker Hub manifest/token timeouts before compilation or tests; only those interrupted infrastructure jobs were retried at the same head. The workflow used publish=false, with signing/publication skipped and no tag created. This draft remains unmerged and publishes no runtime. Upstream searches found no equivalent Worker-only collection-removal fix to port.

from pathlib import Path
out=Path('graph')
out.mkdir(exist_ok=True)
for i in range(1200):
 p=out/f'm{i}.mjs'
 p.write_text('\n'.join([
  f'export const metadata = {{id: "provider-{i}", name: "Model {i}", contextWindow: 128000, input: ["text", "image"], cost: {{input: 0.1, output: 0.3}}}};',
  *[f'export function normalize{j}(x) {{ return {{...metadata, value: String(x).replace(/provider-{i}-field-{j}/g, "field"), key: {j}}}; }}' for j in range(24)],
  'export const schema = new Map(Object.entries(metadata));',
 ]))
(out/'entry.mjs').write_text('\n'.join(f'import * as m{i} from "./m{i}.mjs";' for i in range(1200))+'\nexport const catalog = ['+','.join(f'm{i}' for i in range(1200))+'];\n')

import { Worker, isMainThread, parentPort, workerData } from 'node:worker_threads';
import { performance } from 'node:perf_hooks';
import { writeSync } from 'node:fs';
const [mode='terminate', countText='30', shape='catalog', moduleURL=''] = process.argv.slice(2);
if (!isMainThread) {
  const held = workerData.shape === 'empty' ? {} : workerData.moduleURL ? await import(workerData.moduleURL) : await import('./graph/entry.mjs');
  const objects = Array.from({length: workerData.shape === 'empty' ? 0 : 100000}, (_,i)=>({id:i,value:`model-${i}`,metadata:held, next:null}));
  for(let i=1;i<objects.length;i++) objects[i-1].next=objects[i];
  globalThis.held={held,objects};
  if (workerData.shape === 'sqlite') {
    const {DatabaseSync} = await import('node:sqlite');
    const db = new DatabaseSync(':memory:');
    db.exec('CREATE TABLE entries (id INTEGER PRIMARY KEY, body TEXT); BEGIN');
    const insert = db.prepare('INSERT INTO entries VALUES (?, ?)');
    for(let i=0;i<2000;i++) insert.run(i,`model-${i}`);
    db.exec('COMMIT');
    globalThis.database={db,insert,read:db.prepare('SELECT * FROM entries')};
  }
  parentPort.on('message', () => process.exit(0));
  parentPort.postMessage({ready:true});
} else {
  const rows=[];
  for(let i=0;i<Number(countText);i++) {
    const w=new Worker(new URL(import.meta.url), {workerData:{shape,moduleURL}});
    let ready=false;
    const exited=new Promise((resolve,reject)=>{w.once('exit', code=>ready?resolve(code):reject(new Error(`early exit ${code}`)));w.once('error',reject);});
    await Promise.race([new Promise(resolve=>w.once('message',m=>{if(m.ready){ready=true;resolve();}})),exited]);
    if(mode==='main-exit') { writeSync(1, 'READY_MAIN_EXIT\n'); process.exit(0); }
    const start=performance.now();
    const code = mode==='terminate' ? await w.terminate() : (w.postMessage('exit'), await exited);
    rows.push({i,ms:performance.now()-start,code});
  }
  console.log(JSON.stringify({runtime:process.versions,mode,shape,moduleURL,rows}));
}